Statistical mechanics of scale-free networks at a critical point: 
Complexity without irreversibility? 
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Based on a rigorous extension of classical statistical mechanics to networks, we study a specific 
microscopic network Hamiltonian. The form of this Hamiltonian is derived from the assumption 
that individual nodes increase/decrease their utility by linking to nodes with a higher/lower degree 
than their own. We interpret utility as an equivalent to energy in physical systems and discuss the 
temperature dependence of the emerging networks. We observe the existence of a critical tempera¬ 
ture T r . where total energy (utility) and network-architecture undergo radical changes. Along this 
topological transition we obtain scale-free networks with complex hierarchical topology. In contrast 
to models for scale-free networks introduced so far, the scale-free nature emerges within equilibrium, 
with a clearly defined microcanonical ensemble and the principle of detailed balance strictly fulfilled. 
This provides clear evidence that 'complex’ networks may arise without irreversibility. The results 
presented here should find a wide variety of applications in socio-economic statistical systems. 


Triggered by the vast number of observed non-trivial 
networks in nature, recently a respectable number of 
models have been introduced to understand their sta¬ 
tistical properties. Since many of these networks differ 
considerably from pure random graphs [1], the notion 
of complex networks has emerged which is a nowadays 
well established concept [2. 3]. Perhaps the most ap¬ 
parent property distinguishing such ’complex’ real-world 
networks from pure random graphs is their scale-free de¬ 
gree distribution P{k) ~ /c -7 , which seems to be ubiq¬ 
uitous in nature [3]. Further, many real-world networks 
exhibit a high amount of clustering, and sometimes even 
a non-trivial dependence of the clustering coefficient, C,- 
of node i, when seen as a function of its degree kj. A 
power form of ( C(k )) ~ k~ s can be associated to the 
’complex’ topological property of hierarchical clustering 
[4]. Allmost all of the microscopic models proposed to 
describe such ’complex’, growing or static, networks in¬ 
volve non-equilibrium and evolutionary elements, mani¬ 
festing themselves in different procedures of preferential 
attachment [5-8] or other structured rewirement schemes 
[9-11]. Further, these procedures often involve the need 
for non-local information. The reasoning behind these 
approaches has further solidified the notion of complex 
networks. The concept of non-equilibrium in the context 
of networks is so dominant, that recently even structured 
rewirement schemes have entered the very definition of 
network-ensembles [3, 12]. Less drastic views of ensem¬ 
bles of networks have recently been used to generalize 
random graphs to networks with arbitrary degree [13], 
and to generate scale-free networks by appropriately tun¬ 
ing the weights of ’network-Feynman graphs’ [14]. 

So far, comparatively little has been done to under¬ 
stand complex networks from a purely classical statisti¬ 
cal mechanics point of view, fully satisfying its founda¬ 
tions such as equal a-priori probabilities. Aiming at an 
explanation of scale-free networks based on microscopic 


interactions, several serious equilibrium approaches have 
been proposed [15-17]. In particular topological prop¬ 
erties of networks associated with specific Hamiltonians 
have been studied [9, 16, 17]. The Hamiltonians inves¬ 
tigated there lead to interesting dynamics, but - to our 
knowledge - not to scale-free, complex networks. 

The aim of this paper is to close this fundamental 
gap by proposing a Hamiltonian leading to scale-free, 
hierarchic networks in thermal equilibrium. The form 
of the Hamiltonian is derived from simple, general, and 
socio-economically motivated assumptions about individ¬ 
ual utilities of nodes. Nodes act as utility maximiz¬ 
ers, such as physical particles minimize energy. For the 
greater ease of the exposition of our model we shall use 
the notions of utility and inverse energy interchangeably. 

We consider symmetric networks with a fixed num¬ 
ber of distinguishable nodes i = connected by 

a fixed number of i = 1,L indistinguishable links. 
The network is represented by its adjacency matrix c, 
where Cjj = Cj L — 1, if a link connects nodes i and j 
and Cij = Cji = 0, otherwise. Thus, we define the micro- 
canonical partition function as 

Cl(E,N,L) = Y, 4i(£-W(c))i(£-Tr(^)) , (1) 

P( c) 

with H(c) being the network Hamiltonian and P(c) de¬ 
noting all permutations of the N x N adjacency-matrix. 
This definition guarantees that each possible configura¬ 
tion of the adjacency matrix is realized with the same a 
priori probability. The canonical partition function may 
be obtained by the Laplace transform of Eq. (1), [18], or 
via the maximum entropy principle, as shown in [16], 

Z{T, N, L) = ^2 8 (l~ \ e~ 3n ^ , (2) 

P(c) ' ' 

using the usual definition of temperature T = In 
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FIG. 1: Node-utility as a function of A/c — k~i-kj for different 
values of b. The parameters in Eq. (4) are m = 1, ci = 10, 
02 — 0.5 and C 2 = 1.5. 


FIG. 2: Ensemble average of normalized internal energy 
U(T ) = U(T)/ mm(U{T)) and specific heat C(T) (inset) as 
a function of T, for N = 10 3 , b — 5 and various densities p. 


simulations the canonical ensemble can be generated e.g. 
by the Metropolis-algorithm: starting from an adjacency 
matrix c, a ’virtual’ graph c is generated by a random 
rewirement step. Then, c is accepted with probability 
Paccept = min(l,exp[—/?(7fyc) - 7f(c))]). 

Given Eq. (2) one may study any reasonable Hamilto¬ 
nian depending on any properties of the network. Here, 
we want to adopt the view of modeling microscopic inter¬ 
actions, where the total energy of a network can be ex¬ 
pressed as the sum over all energy/utility contributions 
of individual nodes, Uj. In many realistic settings this 
node-utility will depend on properties/states of node i 
itself, and on properties of the node j whereto a link is 
established. These node-properties are denoted by n(i). 
In this case the Hamiltonian is also expressible as a sum 
over all links, 

w(c) = X>(n(i),no;)) . (3) 

t= 1 

where n^(n(i),n(y)) is the utility of link (. connect¬ 
ing nodes i and j, who are characterized by their 
properties n(i) and n(j), respectively. For simplicity 
we assume linearity and separate U( into the individ¬ 
ual node-contributions d(n(i),n(. 7 ')) = u,-(II(i),n(j)) + 
Uj(n(i),n(j)). In the following we specify the model 
such that the utility of a node increases if it connects 
to a node that is ’more important’ than itself. Simi¬ 
larly, its utility decreases if it establishes a (potentially 
costly) link to a ’less important’ node. As a simple mea¬ 
sure for importance we suggest the degree of a node, i.e. 
n(i) = k;. The relative importance between two nodes 
is denoted by A k = \kj - kj |, which will enter the utility 
function as the only argument. For the particular form of 
the utility function we chose a standard, monotonically 
increasing, concave log-utility function [19], which incor¬ 


porates the concept of decreasing marginal utility [19]. 
We thus model node-utility by 


j c\ 4- d log(5i 4- A k) for ki > k 3 
\ c 2 — a 2 log (&2 + A k) for kj < k 3 


with shape parameters a and b, and offsets c. To avoid 
discontinuity in the utility function we set C 2 = ci 4- 
d log (&i) + a 2 log (b 2 ). This function is shown in Fig. 1. 
For the sake of further simplicity, we assume bi = b 2 = b, 
to obtain a particularly simple form for the link-utility, 


ue(ki, kj) = Ci + c 2 4- (d - a 2 ) log (b + A k) . (5) 

Parameter c\ can be chosen to ensure positive total util¬ 
ity for each link. Parameter b controlls the curvature of 
the utility function [19], and will be called ’sensitivity 
parameter’ in the following. 

Equation (5) can be interpreted as the inverse energy 
of each link which allows us to perform simulations of 
the associated canonical ensemble, Eq. (2). The (col¬ 
lective) amount of ’irrationality’ of individual nodes, i.e. 
that nodes do not fully maximize their utility (by error 
or ignorance) is captured by the ’temperature’ T. For 
d = a 2 , the utility is independent of A k and we ob¬ 
tain random networks, as expected. For a.\ ^ a 2 , the 
constants a and c can be absorbed in the temperature 
scale (Boltzmann constant) of the system; hence they 
are omitted without loss of generality. We assume that 
d > a 2 , meaning that the concave utility-contribution of 
the node of lower degree is more dominant than the con¬ 
vex utility-contribution from the node of larger degree, 
(putting more emphasis on wins than on losses) leading 
to an asymmetry in utility, Fig. 1. We finally base our 
simulations on the Hamiltonian, 


«(c) = -£ log^+AA:) . (6) 
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FIG. 3: Degree distributions at different temperatures for 
N — 10 3 , p — 3, and 6 = 5. The line for T = 5 is the 
Poissonian p(k) - —^P . 


Based on Eq. ( 6 ) we simulate networks of the canonical 
ensemble, Eq. ( 2 ), ranging from N = 500 to 10 4 nodes. 
For computational reasons, temperature-dependent re¬ 
sults are presented for N = 10 3 . All ensemble-averages 
have been calculated from at least 2 x 10 3 configurations, 
separated by at least 20 x N update steps. We analyze the 
obtained networks as a function of the model parameters 
- temperature (irrationality) T, link density p = 2L/N 
and the ’sensitivity’ parameter 6 . 

Figure 2 shows the ensemble average of the total en¬ 
ergy of the system as a function of T for different val¬ 
ues of p. For better comparison data has been normal¬ 
ized to the minimum energy. Also shown is the specific 
heat C, obtained by a numeric derivative of the energy- 
data. One clearly finds a radical change in the energy and 
a characteristic maximum of the specific heat at about 
T c = 0.8-0.85, indicating the presence of a critical point. 
The transition softens for higher link-densities, as well as 
for lower values of b (not shown). We refrain from com¬ 
menting on the size of the underlying critical exponents, 
whose proper extraction is beyond the scope of this work. 

The change in energy is associated with considerable 
restructuring of the underlying networks. To discuss this 
in more detail we have calculated ensemble-averages of 
degree distributions for various points along the transi¬ 
tion. The results are shown in Fig. 3 for N = 10 3 , p = 3 
and 6 = 5. For temperatures up to about T ~ 0.5, we 
observe networks with degrees of all magnitudes. From 
T ~ 0.5 upward, a core of highly connected nodes (bump) 
keeps growing, gradually shifting to the left. For T < 0.8, 
the two regions in the degree distribution coexist. In the 
interval 0.8 < T < 0.95, the highly connected core merges 
with the rest of the network and gradually disappears 



FIG. 4: (a) Finite size dependence of the degree distribution 
for various N and b (inset) and p = 3. For b = 5, we have 
T — 0.95. being somewhat higher for 6=1. (b) Degree 

distribution for different link-densities p, N - 10 3 , and 6 = 5. 
Temperatures are adjusted to the pure scale-free region. 


with further temperature increase. At T ~ 0.95 a pure 
power-law P(k ) ~ lr 7 with exponent 7 ~ 3 matches the 
degree distribution. Ignoring the bump at higher degrees, 
the degree distribution may also be approximated reli¬ 
ably for lower temperatures (down to about T ~ 0.80). 
In the T interval (0.80,0.95] the degree exponent covers a 
range of 7 e [5.5,3], respectively. Increasing the temper¬ 
ature above T = 6.95, keeps the power-law exponent 7 
practically unchanged, but shifts the exponential cutoff 
to the left., ultimately leading to random networks with 
Poissonian distributions, Fig. 3. 

Finite-size effects and the role of parameter 6 for the 
scale-free region are captured in Fig. 4 a. Sizes N = 10 3 
and A r = 8 x 10 3 are compared for 6 = 1 and 6 = 5; both 
exhibit nice scaling. Power-law fits yield a degree expo¬ 
nent of 7 ~ 3 and 2.5 for 6 = 5 and 6=1, respectively, 
regardless of system size. Variation of 6 therefor allows 
to model virtually all exponents occurring in real-world 



FIG. 5: Degree-dependence of the average cluster coefficient 
(C(A’)) at different temperatures. N = 10 3 , p = 3 and 6 = ,5. 

networks [3]. 

In Fig. 5 we show the degree-dependence of ensem¬ 
ble averages of the mean cluster coefficient (C,-)* = 
(2n jki{ki — l)),- where n.j is the number of links between 
the neighbors of node i, [20]. For T = 0.85 we obtain 
a nice scaling-law ( C{k )) = k 6 , with 5 = - 1 . This is 
in very good agreement with many empirically examined 
data [4] and demonstrates that our model reproduces the 
’complex’ topological property of hierarchical clustering 
found in many socio-economical networks. For higher 
temperatures, 6 stays the same, however, the onset of 
the cutoff regime changes, resulting in a flat curve for 
high temperatures (not shown). 

The results presented hold qualitatively for relatively 
small p. For p larger than 5, a characteristic scale grad¬ 
ually emerges, due to the fact that the mean (k), cor¬ 
responding to high-temperature random networks, shifts 
to larger values. Despite this characteristic scale, for ap¬ 
propriate temperatures, a power-law may still be fitted 
to a region, Fig. 4 b. Here temperatures are chosen 
such that the pure scale-free region is recovered (with¬ 
out the bump). The characteristic exponent of 7 = 3 is 
preserved. 

In summary, in the course of a very general modeling 
of socio-economical systems, where individuals are util¬ 
ity maximizers with bounded rationality, we discovered 
that scale-free networks with hierarchical clustering nat¬ 
urally emerge in the vicinity of a critical point. Most 
remarkably, the mechanism behind these results is noth¬ 
ing but the theory of equilibrium statistical mechanics, 
rigorously applied to networks. In substantial contrast 
to work conducted earlier [9, 12], no modifications of the 
sampling of phase-space are used (clearly defined micro- 
canonical ensemble) such that the full power of equilib¬ 


rium statistical mechanics is retained. We have obtained 
the first reversible, equilibrium access to scale-free net¬ 
works based on microscopic interactions satisfying de¬ 
tailed balance. Preferential attachment and structured 
rewirement schemes model many non-equilibrium pro¬ 
cesses in the real world adequately, however, it has to 
be noted that scale-free networks also exist within a pure 
equilibrium concept. Finally, as the notion of complexity 
is usually tightly connected to dissipative structures far 
from equilibrium, our results could stimulate a discussion 
about the actual complexity of ’complex’ networks. 
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